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Abstract 

We investigate overlap fluctuations of the Sherrington-Kirkpatrick 
mean field spin glass model in the framework of the Random Over- 
lap Structure (ROSt). The concept of ROSt has been introduced 
recently by Aizenman and coworkers, who developed a variational 
approach to the Sherrington-Kirkpatrick model. We propose here an 
iterative procedure to show that, in the so-called Boltzmann ROSt, 
Aizenman-Contucci (AC) polynomials naturally arise for almost all 
values of the inverse temperature (not in average over some interval 
only). The same results can be obtained in any Quasi-Stationary 
ROSt, including therefore the Parisi structure. The AC polynomi- 
als impose restrictions on the overlap fluctuations in agreement with 
Parisi theory. 
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1 Introduction 



The study of mean field spin glasses has been very challenging from both a 
physical and a mathematical point of view. It took several years after the 
main model (the Sherrington-Kirkpatrick, or simply SK) was introduced 
before Giorgio Parisi was able to compute the free energy so ingeniously 
( |14| and references therein), and it took much longer still until a fully 
rigorous proof of Parisi's formula was found [131 116) . Parisi went beyond 
the solution for the free energy and gave an Ansatz about the pure states 
of the model as well, prescribing the so-called ultrametric or hierarchical 
organization of the phases f |14j and references therein). From a rigorous 
point of view, the closest the community could get so far to ultrametric- 
ity are identities constraining the probability distribution of the overlaps, 
namely the Aizenman-Contucci (AC) and the Ghirlanda-Guerra identities 
(see PE] respectively). For further reading, we refer to 013 E3> but also 
to the general references ^|[7]. Most of the few important rigorous results 
about mean field spin glasses can be elegantly summarized within a power- 
ful and physically profound approach introduced recently by Aizenman et 
al. in 2; . We want to show here that in this framework the AC identities 
can be deduced too. This is achieved by studying a stochastic stability of 
some kind, similarly to what is discussed in [S], inside the environment (the 
Random Overlap Structure) suggested in [2], and taking into account also 
the intensive nature of the internal energy density. A central point of the 
treatment is a power series expansion similar to the one performed in [SJ. 

The paper is organized as follows. In section 2 we introduce the concept 
of Random Overlap Structure (henceforth ROSt), and use it to state the 
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related Extended Variational Principle. In section 3 we present the main 
results regarding the AC identities and similar families of relations. In 
Appendix A we emphasize that the same results are valid in any Quasi- 
Stationary ROSt, not just the Boltzmann one. 

2 Model, notations, previous basic results 

The Hamiltonian of the SK model is defined on Ising spin configurations 
a : i — > <7j = ±1 of N spins, labeled by i = 1, . . . , N, as 



where Jjj are i.i.d. centered unit Gaussian random variables. We will 
assume there is no external field. Being a centered Gaussian variable, the 
Hamiltonian is determined by its covariance 



is the overlap, and E denotes here the expectation with respect to all the 
(quenched) Gaussian variables. 

The partition function Z N {(3), the quenched free energy density /at(/3) 
and pressure a/v(/3) are defined as: 




E[H N (a)H N (a')} = l -Nql 



where 




Y,exp(-l3H N {a)) , 



-Pfstf) - ±- T ElnZ N ((3)=a N (f3) . 
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The Boltzmann-Gibbs average of an observable 0(a) is denoted by u and 
denned as 



but we will use the same u to indicate in general (weighted) sums over 
spins or non-quenched variables, to be specified when needed, and with f2 
we will mean the product (replica) measure of the needed number of copies 

of UJ. 

Let us now introduce an auxiliary system. 

Definition 1 A Random Overlap Structure 1Z is a triple (T,,q, £) where 

• £ 9 7 is a discrete space (set of abstract spin-configurations); 

• q : T? — > [0,1] is a positive definite kernel f Overlap Kernel,), with 
\q\ < 1 (and q = 1 on the diagonal of T, 2 ); 

• £ : S — > M + is a normalized discrete positive random measure, i.e. a 
system of random weights such that there is a probability measure /j, 
on [0, 1] E so that X] 7 eE£7 < 00 a ^ mos ^ surely in the [i-sense. 

The randomness in the weights £ is independent of the randomness of the 
quenched variables from the original system with spins a. We equip a ROSt 
with two families of independent and centered Gaussians hi and H with 
covariances 



(O) = Z^y 1 £ 0(a) eM~PH N (a)) 



a 



E[hi {~f)hj{i)\ = 5 i3 q iy , 
E[£( 7 )£(7')] = 



(1) 



(2) 
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Given a ROSt 1Z we define the trial pressure as 

G w (^) = l E ln E ^^ eXP( ~ /3E ^^ (7K) , (3) 
N E 7 ^exp(-/3Vf^(7)) 

where E denotes hereafter the expectation with respect to all the (quenched) 
random variables (including the randomness in the random weights £) but 
spins a and the abstract spins 7, the sum over which is in fact written 
explicitly. 

The following theorem ([2]) can be easily proven by interpolation 

Theorem 1 (Extended Variational Principle) Infimizing for each N 
separately the trial function Gn{TZ) defined in (0) over the whole ROSt 
space, the resulting sequence tends to the limiting pressure —/3f(f3) of the 
SK model as N tends to infinity 

a{(3) = lim oln{P) = hm inf Gn{TZ) ■ 

N—>oa N—>og 7Z 

For a given ROSt, the trial pressures {Gn} are a well defined sequence 
of real numbers indexed by N; a ROSt 1Z is said to be optimal if a = 
lim^y — yOQ ctjy(/?) = limjv^oo Gn(TV) V/3 . See ^ for comments on some 
topological aspects of the ROSt theory. The space of all ROSt can be 
restricted to those ROSt's enjoying some factorization property that all 
optimal ROSt's enjoy, without missing the exact pressure We will 

therefore limit ourselves to these ROSt's, called Quasi-Stationary. 

An optimal ROSt is the Parisi one f |X4I IXfc>| ^ . another optimal one is the 
so-called Boltzmann ROSt TZb, defined as follows. Take S = { — 1, 1} M , 
and denote by t the points of S. We clearly have in mind an auxiliary spin 
systems (and that is why we use r as opposed to the previous 7 to denote 
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its points). In fact, we also choose 

Y AI i 1 ' M 

h = -= JikTk , H = -— J2 JklTkTL 



^ k=l ^ k,l 

which satisfy with q TT i = jj^2k T k T ki an d J an d J are families of 

i.i.d. random variables independent of the original couplings J, with whom 
they share the same distribution (i.e. all the J and J are centered unit 
Gaussian random variables). The variables h. are called cavity fields. Let 
us also choose 

/ 1 M/ . 
£ r = cxp(-/3 J ff M (r; J)) = exp ( ^2 J klTkn 

^ ^ k,i 

If we call 1Zb{M) the structure defined above, we will formally write 
TZb{M) — > TZb as M — > oo, and we call TZb the Boltzmann ROSt. The 
reason why such a ROSt is optimal is purely thermodynamic, and equiv- 
alent to the existence of the thermodynamic limit of the free energy per 
spin. A detailed proof of this fact can be found in [2]; here we just mention 
the main point: 

a{[3) = Clim j-Eln N+M = Urn C]imG N {n B {M)) = G N (K B ) = G(K B ) 

where C lim is the limit in the Cesaro sense. Notice that the Boltzmann 
ROSt does not depend on N, after the M-limit. 



3 Analysis of the Boltzmann ROSt 

In this section we show that in the optimal Boltzmann ROSt's the overlap 
fluctuations obey some restrictions, namely those found by Aizenman and 
Contucci in p^. In other words we exhibit a recipe to generate the AC 
polynomials within the ROSt approach. 

G 



3.1 the internal energy term 

Let us focus on the denominator of the trial pressure G(1Zb): defined in 
computed at the Boltzmann ROSt TZb, defined in the previous sec- 
tion. Let us normalize this quantity by dividing by Zn and weight H with 
an independent variable f3' as opposed to (3, which appears in the Boltz- 
mannfaktor £ T . As in the Boltzmann structure we have actual spins (r) 
and we do not use the spins a here, we will still use to (or Q) to denote 
the Boltzmann-Gibbs (replica) measure (at inverse temperature /3) in the 
space £ = { — 1, 1} M . Moreover, we will use the notation (•) = E£l(-) and, 
if present, a subscript (3 recalls that the Boltzmannfaktor in f2 has inverse 
temperature (3. More precisely, we are computing the left hand side of the 
next equality to get this 

Lemma 1 

lElnfiexp Lf3'^H{r) \ = ^(1 - . (4) 

Similar calculations have been performed already, but in this specific con- 
text the result has been only stated without proof in while a detailed 
proof is given only in the dilute case in 10 . So let us prove the lemma. 
Let us take M finite. Thanks to the property of addition of independent 
Gaussian variables, the left hand side of (@J is the same as 



which in turn, thanks to the convexity of a, can be estimated as follows 

^(/3* - (3)a' M {(3) < ^(a M ((3*) - a M {(3)) < ^(/3* - P)a' M (f3*) ■ 
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Now 



Therefore, when M — > oo, we get (0J for almost all j3, i.e. whenever 
a'((3*) — > ot!{0), or equivalently whenever — > (•) i g. Notice that the 
quantity in (0} does not depend on N [121 ll(J| . 

Theorem 2 T/ie following statements hold: 

• T/ie Ze/i /land side of ^jj is intensive ( does not depend on N ); 

• The left hand side of is a monomial of order two in j3' ; 

• The Aizenman-Contucci identities hold. 



Proof 

Recall that H is a centered Gaussian, and so is therefore — H and the Gibbs 
measure is such that the substitution H — > H — H' implies 

Expand now in powers of (3' the exponential first and then the logarithm. 



1 

2N^ 



-Ehift 



P' 2 N~ » M9 /3' 4 iV 2 » 



i 



-E 



iV/3' ; 



2iV 

T¥ 

~2~T 



i2fl(H 2 ) - 2tt 2 {H)) 



n 2 {H 2 ) + n 4 (H) - 2n(H 2 )n 2 (H) 
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A straightforward calculation yields 
EO(i? 4 ) = 3 , E[n{H 3 )n(H)} = 3<g? a ) , En 2 (H 2 ) = 1 + 2{q\ 2 ) , 

E[n(H 2 )n 2 (H)} = (q 2 12 ) + 2(q 2 12 q 2 3 ) , Ef! 4 (i?) = 3(q 2 12 q 2 4 ) 

and so on. All quantities of this sort can be computed in the same way. As 
an example, let us calculate E[n(H 2 )n 2 (H)] = E[uj(H 2 )lu(H 2 )lu(H 3 )}. Like 
for overlaps, subscripts denote replicas. In order to evaluate the expectation 
of products of Gaussian variables, we can use Wick's theorem: we just count 
all the possible ways to contract the four Gaussian terms H i , H i , H 2 , H 3 
and sum over every non-vanishing contribution 

(Hjl 2 Hjl 3 ) = (q 2 12 q 2 3 ) , (5) 
{SJfrtj&ka) = (1 • q\ 2 ) , (6) 

(H?H 3 Hjl 2 ) = (q 2 12 q 2 23 ) . (7) 

The sum of all the terms gives the exactly (q\ 2 ) + 2(q 2 2 q 23 )- Now equation 
Q is therefore expressed in terms of an identity for all /?' of two polynomials 
in P': one is of order two, the other is a whole power series. We can then 
equate the coefficients of same order, or cquivalently put to zero all the 
terms of order higher that two in f3' . The consequent equalities are exactly 
the Aizenman-Contucci ones (^0), an example of these is 

(«f 2 ) - Hfufis) + 3<«? a «§4) = , 
which arises from the lowest order in the expansion above. □ 
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3.2 the entropy term 

In the same spirit as in the previous section, let us move on to the normal- 
ized numerator of the trial pressure G(1Zb), defined in (jSJ), computed at 
the Boltzmann ROSt TZb, defined in the previous section. If we define 

Ci = 2 cosh(— (3 hi) = ^ exp(— /3/ijCTj) , 

then 

1 N 1 

— Ehin^2 exp(-j3 22 hiai) = — ElnO(ci • • • c N ) (8) 

does not depend on N [2IE]|, if we consider the infinite Boltzmann ROSt, 
where M — ► oo. 

Again, assume we replace the /3 in front of the cavity fields h, (but not 
in the state f2) with a parameter y/i, and define, upon rescaling, 

ft N 

=Elnr^exp-^=^/i 4 cr l . (9) 

We want to study the flux (in t) of equation © to obtain an integrable 
expansion. The i-flux of the cavity function ^ is given by 

CW) = («12&2>t) , (10) 

which is easily seen by means of a standard use of Gaussian integration by 
parts. The subscript in (-) t = Ef2 t means that such an average includes 
the t-dependent exponential appearing in 0, beyond the sum over a. 

Theorem 3 Let F s be measurable with respect to the a-algebra generated 
by the overlaps of s replicas of {a} and {r}. Then the cavity streaming 
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equation is 
dt(F s ) t = 

1 s s s(s + 1) 

(-Fs(y^g 7 ,,5ff7,<5 - S ^ g 7iS+ ig 7iS+ i -I Q , s +l,s+2'Z s +l : s+2))t • (11) 

7,5 7=1 

Proof 

We consider the Boltzmann ROSt TZb(M) with any value of M. The proof 
relies on the repeated application of the usual integration by parts formula 
for Gaussian variables 



£ CTr ^ s ex P (-/?if M (r)) exp(«/5^£« £ 7 -W^J) 
d t (F s ) t = 9 t E 5f - — — 



E CTT exp(-/3iJ M (r)) cxp(y / ^ X)« E 7 4^7 CT 

*j 7 

— =L= E EJ «(E n t [F sT 7a]] - sfi^Mr^]) 
V ^ 7 

7,<5 (5 



= ^E(y^0 t [F s g 7 ^g 7 ^] - sy^0 t [Fsg 7)S+ ig 7iS+ i] 

7,5 7 
+SS^t[-F , s Q' s +l, s +25s+l,s+2] 

— s$lt[F s ]$lt[F s q s+ i, s+ 2qs+i,s+2\) , 

where in fi t we have included the sum over a and r, the Boltzmannfaktor 
in t, and the i-dependent exponential. At this point, remembering that 
<7 77 = 1, we can write 

E [Fsq-tsq-ts] = 2^fi ( [F s q 7 sq 7 s] + sil t [F s ] . 

7,<5 7,<5 
11 



which completes the proof. □ 

Now the way to proceed is simple: we have to expand the i-derivative of 
'f(i) (right hand side of JTOJl) using the cavity streaming equation and 
we will stop the iteration at the first non trivial order (that is expected to be 
at least four, being the first AC relation of that order). Once a closed- form 
expression is in our hands, we can write down an order by order expansion 
of the (modified) denominator of the Boltzmann ROSt (that is the function 
N-t-ipty) evaluated for t = N(3 2 ). We have 

d t (qi2qi2)t = (?129l2 - 4gi2gi2<Z23<?23 + 3<7i 2 gi2<734<734)t ■ 

After the first iteration: 

<9t(<?i29i2)t = (<7i2<?i2 ~ 4g?2<7i2923P23 + 3ql 2 qf 2 q 34 )t , 

<9 t (9l29l2923923)t = (<7l29l2<?23<3 , 23<?13 l 2 , 13 + 29l 2 9l2923923 

- 69i 2 9l2923923934934 ~ 39i 2 9l29l39l39l49l4 + 69\ 2 9l2934934945945)t , 

£^(912912934934)* = (4912912923923934934 + 2g 12 9i 2 934934 

- 16912912934934945945 + 109i29l2934934956956)t ■ 

The higher orders can be obtained exactly in the same way, so we can write 
down right away the expression for (912912)) referring to 013] for a detailed 
explanation of this iterative method: 

(912912)* = (9i29i2) f - 2(q 12 q 12 q 23 q 23 q 13 q 13 )t 2 ~ 7r(9i 2 9i2)* 3 

6 

3 

- 2 (9l29l 2 923923) t3 + 2 ^12 ^12934934) <3 + 6(9i29l29239239349349l49l4)£ 3 • 

(12) 
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Notice that the averages no longer depend on t. In this expansion we 
considered both ^-overlaps and g-overlaps, but as the sum over the spins a 
can be performed explicitly, we can obtain an explicit expression at least 
for the g-overlaps, and get 

ij 



(912923931) = -^E.^2,u){a i a j )u){ajak)w(a k (Ti) = — % , 

ijk 

(9i2934> = jf4^^2u 2 (aiaj)uj 2 ((T k (Ti) = —5 



ijkl 

(912923934914) = ^E^o;(CTiCTj)w(a-j(7 fc )w((7fc(7;)w((7;a-i) = i , 

/ 4 x 1 / \ / x 3(JV-1) 1 
(9l 2 ) = -^E2 J ^(ff,ff,^^mffi^"k''l) = ^3 + ^3 , 

ijkl 

(912923) = ■^ l ^^2^{cj l (Jj)uj{(j t cj ] a k ai)uj{a l <7 j ) = • 

Moreover, as the g-overlaps have been calculated explicitly, we can use a 
graphical formalism ^ [5] . In such a formalism we use points to identify 
replicas and lines for the overlaps between them. So for example: 

(— ) = (912), (O) = (qj 2 ), (A) = (q 12 q 23 q 13 ) 

and so on. Now we can integrate (|10[l thanks to the polynomial expansion 
based on fl^|) and to the expressions for the ^-fluctuations. We obtain 

nt) = l I [1- (912912)*']*' , 



( n)^ + ^[-L(0)-i ( oo> + i(8)]. (i 3 ) 
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This expression, though truncated at this low order, already looks pretty 
much alike the expansion found using the internal energy part of the Boltz- 
mann pressure. 

We stress however two important features of expression (|13|) . The first is 
that within this approach we do not have problems concerning the Replica 
Simmetry Anzatz (RS) |14| , and this can be seen by the proliferating of the 
overalaps fluctuations, via which we expand the entropy (a RS theory does 
not allow such fluctuations). Secondly, we note that not all the terms inside 
the equations (|13|l are intensive: the last three graphs are all multiplied by 
a factor N. Recalling that this expansion does not depend on N, and 
physically a density is intensive by definition, we put to zero all the terms 
in the squared bracket, so to have 

(©-400 +3 0) = o. 

Again we can find the AC identities. 

A Extension to all Quasi-Stationary ROSt's 

For sake of simplicity, all the explicit calculation we performed took into 
account the Boltmann structure only. But the whole content actually does 
not depend on the explicit form of the Hamiltonians, it merely relies on the 
Gaussian nature of the random variables and their moments, independently 
of the space they are defined in. In other words, as long as we consider 
centered Gaussian variables, the whole treatment depends only on their 
covariances. That is why changing the ROSt does not change the results, 
except the overlaps in the various expressions will be those of the considered 
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ROSt (e.g. the ultrametric Parisi trial overlaps), provided some properties 
are preserved (Quasi-Stationarity). 

Let us focus for instance on the internal energy part, which is sim- 
pler, and see that the results of subsection 13 . II are the same in any Quasi- 
Stationary ROSt. First of all, notice that the proof of Theorem [2] never 
makes use of the explicit form of the Hamiltonians and therefore iJSJ-JSJ- 
J7J) stay identical, as they are determined purely by the covariances of the 
Hamiltonians. The same clearly holds for all the other terms not explicitly 
considered in the example. 

So the validity of the results coincides with the validity of Lemma ^ 
The ROSt's for which such a lemma holds are called Quasi-Stationary (see 
OEj), in this case with respect to the Cavity Step (see [121 IS]). Notice 
that the left hand side of l@J is zero for j3' = independently of the par- 
ticular ROSt. Hence by the fundamental theorem of calculus the same left 
hand side coincides with the integral from zero to (3 1 of its derivative (with 
respect to /?'). But the form of such a derivative is just determined by the 
covariance of H (this is at the heart of 0), which is always defined to be 
an overlap. Therefore a simple Gaussian integration by parts, as illustrated 
in leads to the right hand side of These are the intuitive reasons 
that heuristically explain why both the explicit calculation in Lemma^and 
the expansion of Theorem [5] are the same in any Quasi-Stationary ROSt, 
and so are the AC polynomials, no matter what the overlap looks like in 
a generic abstract space. So AC polynomials hold in any Quasi-Stationary 
ROSt, non-optimal too, but if the chosen ROSt is not optimal there will 
be no overlap locking and the trial overlap will have very little to share 
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with the true ones of the model. Moreover Q will not in general provide 
the internal energy of the model (but this can be the case in some optimal 
ROSt too, like the Parisi one!). 

Conclusions and Outlook 

We have shown how some constraints on the distribution of the overlap nat- 
urally arise within the Random Overlap Structure approach. As our anal- 
ysis of the Boltzmann ROSt is similar to the study of stochastic stability it 
is not surprising that the constraints coincide with the Aizenman-Contucci 
identities. In the ROSt context, such identities are easily connected with 
the existence of the thermodynamic limit of the free energy density (which 
is equivalent to the optimality of the Boltzmann ROSt) and with the phys- 
ical fact that the internal energy is intensive. We also showed that, as 
expected, the entropy part of the free energy yields the same constraints 
as the other part (i.e. the internal energy). 

The hope for the near future is that the ROSt approach will lead even- 
tually to a good understanding of the pure states and the phase transitions 
of the model. A first step has been taken in ^21 > an d our present results can 
be considered as a second step in this direction. (Other more interesting 
results regarding the phase transition at = 1 can also be obtained with 
the same techniques employed here, including the graphical representation 
A further step should bring the Ghirlanda-Guerra identities, and then 
hopefully a proof of ultrametricity. 
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